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ABSTRACT 

The  electrical  activity  of  the  brain 
in  response  to  a visual  scene  is  being 
used  as  an  adjunct  to  measurement  techni- 
ques in  several  human  engineering  and 
medical  applications.  Recorded  from 
electrodes  placed  on  the  subject's  scalp, 
this  'evoked  potential'  sensitively 
measures  the  way  that  the  human  responds 
to  differing  presentations  of  the  out- 
side world.  It  permits  evaluation  of 
the  effects  of  changes  in  the  sensory 
qualities  of  a displayed  scene,  as  well 
as  the  cognitive  demands  and  response 
requirements  of  a specific  task.  As 
such,  the  evoked  potential  provides  a 
unified  metric  which  allows  the  engineer- 
ing psychologist  to  assess  the  total 
requirements  placed  on  the  subject,  from 
sensory  input  to  motor  output.  Several 
studies  are  reported  utilizing  this 
technique  to  answer  questions  of  display 
design  and  operator  perfoimance.  For 
the  future,  improvements  in  recording 
and  analysis  should  allow  this  technology 
to  move  from  the  laboratory  to  the  field, 
and  permit  rapid  assessment  of  such  sub- 
jective factors  as  fatigue,  attention, 
psychological  distress  and  other  poten- 
tially dangerous  operator  states. 

INTRODUCTION 

The  behavioral  metrics  typically 
used  by  engineering  psychologists  to 
assess  man/machine  interactions  have 
proven  their  validity  and  reliability 
over  many  years  of  application.  However, 
as  the  sophistication  of  operator  systems 
increases,  we  find  ourselves  faced  with 
the  need  to  provide  increasingly  finer 
measurements  in  order  to  answer  more 
and  more  complex  questions.  It  is  no 
longer  adequate  to  decide  that  perfor- 
mance is  or  is  not  better  with  a given 
display  or  equipment  design.  Engineers 
and  planners  now  need  to  know  why  a given 
system  is  different,  so  that  they  can 
intelligently  determine  tradeoffs  with 
some  other  aspect  of  a complex  design. 

In  effect,  it  is  necessary  to  adopt  not 


only  an  end-product  orientation  with 
respect  to  how  well  the  human  can  per- 
form, but  to  enter  intensively  into  the 
process  involved  in  achieving  a given 
level  of  performance.  Behavioral  mea- 
sures such  as  reaction  time,  percent- 
correct,  tracking  describing  functions, 
etc.,  enter  into  performance  processes 
indirectly,  if  at  all,  and  usually  are 
applicable  to  a very  narrow  range  of 
performance.  What  is  needed  as  an 
adjunct  to  these  techniques  is  a general, 
direct  measurement  of  the  subject's 
performance  under  a given  system.  Pref- 
erably, such  a measurement  technique 
should  be  able  to  reflect  the  subject's 
reactions  to  physical  attributes  of  the 
system  (size,  shape,  color,  weight,  etc.), 
cognitive  demands  imposed  in  interacting 
with  the  system  (information  processing, 
decision  making,  memory,  etc.),  and  the 
motor  requirements  of  the  system 
(strength,  speed,  accuracy,  etc.  of  the 
response  required) . This  Utopian  goal 
may  never  be  achieved  with  a single 
metric.  However,  we  believe  that  one 
technique,  the  evoked  potential  (E.P.) 
of  the  brain,  approaches  the  above 
requirements,  and  promises  a fertile 
field  for  future  research  and  applica- 
tion. 

The  evoked  potential  is  the  electri- 
cal activity  of  the  brain  which  is 
produced,  or  evoked,  by  a discrete 
event.  In  order  to  isolate  this 
response,  we  typically  expose  the  sub- 
ject to  a single  stimulus,  and  simul- 
taneously record  the  electroencephalo- 
gram (EEG) . The  brain's  response  to 
that  stimulus  is  extremely  small 
relative  to  the  on-going  background  EEG, 
which  can  be  considered  "noise"  in  this 
context.  This  is  an  unfavorable  signal- 
to-noise  ratio  which  can  be  improved  in 
several  ways.  The  most  common  technique 
involves  presenting  the  stimulus  many 
times  and  averaging  the  EEG  in  a time- 
locked  way  immediately  after  each  pre- 
sentation. This  reduces  the  randomly 
occurring  EEG  "noise"  to  a theoretical 
zero,  and  allows  the  real  "evoked 
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potential"  to  be  seen  clearly.  Typically, 
a strong  stimulus  will  produce  a clear 
EP  with  less  than  32  stimulations.  In 
the  case  of  the  visually  evoked  response, 
the  EP  will  measure  10  to  20  microvolts 
peak-to-peak , and  will  develop  from  a 
background  EEG  of  up  to  200  microvolts. 
Since  most  of  our  applications  thus  far 
have  involved  visual  stimuli,  we  will 
limit  our  discussion  to  the  Visually 
Evoked  Respone  (VER) . However,  similar 
applications  are  being  made  for  re- 
sponses evoked  from  the  auditory, 
tactile,  and  vestibular  systems.^ 

The  Transient  Evoked  Potential 


An  idealized  visual  response  obtained 
by  relatively  slow  repetition  of  the 
stimulus  consists  of  several  consistent 
peaks  and  valleys,  usually  identified 
sequentially  as  positive  (Pj^»  P2' 
or  negative  (N.,  N2,  etc.),  or  occasion- 
ally by  the  latency  of  the  peak  in  milli- 
seconds (e.g.  Pj  or  P300) . This  is 
called  the  transient  evoked  potential. 

It  is  possible  to  divide  the  VER  into 
major  segments  which  apparently  are 
generated  by  different  sources  in  the 
brain,  and  which  are  sensitive  to  dif- 
ferent qualities  of  the  stimulus  con- 
dition (figure  1).  The  first  major 
segment  of  the  VER  extends  across  the 
first  250  milliseconds  or  so  of  stimula- 
tion. This  part  of  the  waveform  seems 
to  be  particularly  responsive  to  mani- 
pulations of  the  physical  attributes  of 
the  visual  stimulus  such  as  color* 
intensity,  movement,  or  motion.^' 

For  example,  the  N,  peak  is  extremely 
sensitive  to  the  sharpness  of  a dis- 
played image.  If  a checkerboard  pattern 
is  out  of  focus,  this  N.  ^component  will 
be  diminished  or  absent.  5 Using  this 
technique,  many  schools  of  optometry 
are  now  prescribing  glasses  for  infants 
and  others  incapable  of  verbal  response. 
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Figure  1.  Visual  Evoked  Respon.se 


The  second  major  segment  of  the  VER 
extends  from  about  250  to  500  millisec- 
onds, and  seems  to  be  exquisitely 
responsive  to  what  has  been  called  "pro- 
cessing sensitivity".  In  particular, 
one  peak  (the  P^  or  P300)  appears  sensi- 
tive to  changes  in  the  information  pro- 
cessing demands  being  made  on  the  subject. 
Several  studies  have  indicated  that 
enhancement  of  this  peak  is  uniquely 
associated  with  the  occurrence  or  expec- 
tation of  a signal,  or  with  its  correct 
detection.^  The  P300  varies  predictably 
when  we  experimentally  manipulate 
memory  load,  expectancy,  a shift  in  a 
motor  set,  or  detection  of  a threshold 
stimulus. **  In  this  context,  the  P300 
can  be  considered  to  reflect  cognitive 
functions . 

The  last  period  of  time  in  the 
evoked  response,  after  500  milliseconds, 
appears  to  represent  the  efferent  firing 
involved  in  the  motor  response  itself, 
or  a muscle  component  of  the  response. 

As  of  yet,  very  little  is  known  about 
this  component  of  the  EP,  but  it  may 
well  represent  a less  contaminated 
measure  of  actual  response  latency  than 
traditional  reaction  time  measures. 

The  Steady-State  Evoked  Potential 

The  transient  evoked  potential  has 
been  known  for  sometime,  and  forms  the 
foundation  of  many  current  applica- 
tions of  EP  technology.  A different 
type  of  evoked  response  has  been  more 
recently  described,  however,  which 
promises  to  be  equally  productive.^ 

In  this  technique,  the  display  is 
flashed  very  rapidly,  between  eight  and 
twelve  times  per  second.  The  EEG  is 
recorded  in  the  same  way  as  for  the 
transient  evoked  response.  However, 
by  appropriate  filtering,  only  activity 
occurring  at  the  stimulating  frequency 
is  considered.  This  results  in  an  out- 
put which  is  identical,  in  the  frequency 
domain,  to  the  input  frequency.  In 
effect,  this  technique  constrains  a 
part  of  the  brain's  transmission  process 
to  achieve  a "steady-state",  and  this  is 
measured  by  the  quality  of  the  evoked 
potential  at  the  input  frequency.  The 
EP  parameters  which  can  still  vary  with 
stimulus  variations  under  this  con- 
strained situation  are  amplitude  and 
phase  angle.  ■This  introduces  great 
consistency  between  subjects.  Since 
those  parameters  are  sensitive  to  very 
small  changes  in  the  stimulating  envir- 
onment, the  measure  provides  a stable 
and  reliable  index  of  sensory  process- 
ing. Using  this  technique,  investiga- 
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tors  have'  i slu'd  that  dirf'ct, 

•a  j oc  1 i\"*'  r'  ' 1 1 su ircMUt.*  • il...  of  both  .ibr'.olutQ 
i,ncl  clil  I I'l  ont  ial  psyi.  lui;jhysic,.il  i liror,- 
holdti  call  be  obt.i  i n< -il . In  ad^lilion, 

the  tochnique  mentioned  above  for  pro- 
t.cribincj  <;|asHos  can  be  modified  to 
utili/io  tlie  r.teady  state  evoki*d  rosiionsc. 
Since  the  cnily  Uiinq  viryinq  v/itli  sharp- 
ness of  tlie  iniaqci  is  amplitude,  a 
technician  can  now  perform  the  test  by 
r.ir.iply  observinej  a number  indicnitincj 
response  amplitude,  never  havinq  to  view 
3 waveform. 

The  V i taut  1_  LLLX 

In  view  of  these'  capabilities  of  the 
VEK,  and  of  the  Air  I'urce  interest  in 
providinc)  objective  m<MSuros  of  operator 
display  quality,  we  liave  established  a 
visual  response  facility  in  the  Human 
Knqineerinq  Division  of  the  Aerospace 
•■'.edical  Kescarch  bnboratory,  Wricjht- 
Patterson  Al’B,  Ohio.  A schematic 
representation  of  the  elements  of  this 
laboratory  is  presented  in  Fiqure  2. 


A1 thouqh  the  lAC  chamber  is  avail- 
able tC)  provide  RF  .shieidiiiq  if  mices- 
fiary,  the  statc-of-the-c'irt  in  recording 
electrodes  and  amplifiers  makes  this 
unnecessary  in  most  cases.  Visual  or 
other  stimuli  are  introduced  to  the 
subject,  and  he  or  slie  may  respond 
behavioral  1 y or  not,  depending  on  the 
particular  experiment.  The  EEC  is 
recorded  from  scalp  electrodes  and 
prissed  through  high  impedence  probes  to 
high  gain  amplifiers.  From  there  the 
signal  is  recorded  on  analog  tape,  and 
simultaneously  may  bo  processed  through 
a PDP  11/35  computer  or  a hardwirt.'d 
Nicolet  signal  averager.  Peripheral 
displays  and  other  data  handling 
apparatus  permit  great  flexibility  in 
the  control,  recording  and  analysis  of 
experiments . 

This  laboratory  allows  us  to  record 
both  transient  and  steady  state  evoked 
responses.  The  computer  facility 
allows  us  to  determine  the  precise 
relationsliip  between  the  evoked  response 
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B rind  nny  bi-hav  i or , r.ucli  as  reacf  ion  time 

f trackin'!,  v;liit;h  nsiy  ov:;;m  at  thy  s.iiiio 

Wo  aro  c..ipahl<>  of  locording  other 
r.syrhophvHioloijical  tiuvisuroinontn  simul- 
raiK.'Oiisly  in  order  to  obt.iin  additional 
rorreUitcs  of  beliavior  or  inain  activity. 
In  addition,  t lie  laboimtory  possoss.os  a 
f.tanford  Ker.oarch  Institute  eye  tracker 
..liieh  uses  the  lourth  I’urt.injc  imatje  of: 

311  IK  .source  reflected  from  the  lens. 

.his  permits  us  to  deti.iminc,  within  one 
r-.iriuto  of  arc,  precisely  whore  the  sub- 
ject is  lookiiKj.  Tc)(|et.her , these 
facilities  provide  a flexible  and  precise 
environment  for  conductiiu)  a wide 
•.ariety  of  studies  dealiny  with  displtiy 
iosign . 

EXPF.RIHIKITAI,  KTUblES 
n f f e cts  of  1 11  f o rmat i on  I’roc essing  Tasks 

An  early  utilization  of  this  facility 
involved  .studic.s  designed  to  evaluate 
I the  information  proeessinc)  load  imposed 

by  the  use  of  I,ED  dot  matrix  alphabet 
letti'rs  in  aircralt  displays.  There  vias 
a question  coneernitu|  the  degree  to  which 
such  displays  would  force  the  operator 
to  utilize  an  extra  processing  stcfi  in 
order  to  translate  the  dot  symbol  into 
a useable  "Gestalt"  in  order  to  process 
it  like  a familiar  stroke  letter. 

Hoaction  time  studies  could  reveal  no 
difference  bcLv/een  the  two  symbologies, 
.out  those  were  unconvincing  since  reac- 
tion time  is  such  a nolorioucly  variable 
noasuro.  It  was  also  possible  that  the 
subject  w,i.s  simply  "working  harder"  to 
» produce  a good  reaction  time  v/ith  the 

dot  symbology.  If  this  was  the  case, 
such  a worklofid  might  lead  to  greater 
errors  and  more  accidents.  A significant 
engineering  development  protjram  v/as  being 
delayed  until  tlu*  processing  secinence 
could  be  5;tudied  in  more;  detail. 

ij  We  performed  two  studies  utilizing 

a complex  reaction  time  paradigm  to 
compare  tlx.-  subject's  response;  to  dot 
2nd  stroke  lotlc-rs.^  1 1\  addition,  how- 
ever, we  also  obtained  transient  evoked 
responses  to  the  [)resent  at  ion  of  each 
syniboloqy  separately.  Analy.sis  revealed 
'o  reaction  time  difference  in  either 
study.  For  the;  Vl'lJt,  no  peaks  showt'd 
significant  latency  or  iimplitude  difler- 
.nee.s  except  one.  The  one  j>enk  showing 
2 difference  wa*:  the  peak,  which  is 
usually  considered  to  correlate  with 
tiio  end  of  the  encoding  st.u)e  of  infor- 
.’•ation  processing.  (Fig.  1)  In  both 
studies,  this  peak  w,is  signi  f ii:antl  y 
later  for  the  dot  symbol oc|y  as  oi>por.ed 
; ‘o  the  strokt's.  In  absolute  t(;rms,  fne 


difference  met‘i;;ured  betv/een  4 and  10 
m i 1 1 i s(;cond:; . in  addition,  this  differ- 
ence was  "m.idf;  up"  by  the  next  negative 
trrnxjh  nc>ne  of  the  ampli- 

tude differences  were  significant  be- 
tween symbologies,  it,  r;ould  be  argued 
that  this  pattern  of  resjionses  was  not 
accompanied  by  an  increase  in  workload 
on  the  part  of  the  subject. 


Figure  3.  Vortex  I.ntoncy  in  Msec, 
for  two  different  symbologies. 

This  was  the  first  instance,  to  our 
knowledge,  of  the  VKR  being  used 
specifically  to  answf;r  a human  engineer- 
ing question  involving  actual  di.splay 
dc.sign.  Ttie  net  effect  of  these  studios 
was;  fo  break  Ltu;  total  reaction  time 
into  constitunnf  jiart.s.  By  doing  this, 
we  were  able  to  show  that  a statistie.nl- 
]y  sit)nirican!  ili  f f ertutce  did  e.xist  in 
proccssinej  of  the  visu.'l  .stimulus,  and 
wo  were  able  to  interpret  the  r.eaniiui 
of  the  difference.  In  place  of  the 
unprovablo  negative  result,  wo  supplied 
a positive  rcsjult.  Rccausie  of  the 
pretsision  and  confidence  inherent  in 
f;uch  a result,  enejineers  were  able  to 
make  an  opi'rational  decision  that  the 
stmal  1 time  cJiffer<;nce  between  .symbolo- 
gies would  not  lead  to  a gonuinss 
behavittral  effect  which  would  have 
unacceptable  nt.-gative  consequences  on 
the  ojjorator. 

Ef f t'c^l^s  of  nis'.play  Relevance  and  Work- 

In  a similar  effort,  we  looked  at 
this  effect ::  of  cognitive  "workload" 
and  "meaning"  on  the  VER."  lining  a 
paradigm  report  ed  ext.enr,  i v>' 1 y by  Stern- 
berg, v/e  te(|uiia;d  tiu'  .subjects  to 
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r!;iHoriv'o  It'tterc  of  Itu.'  nlphahol  . Thone 
■.>•■11:  clofi.n'v!  iir.  " ri  • I avan  " or  i'oc;i!  iva- 
r.ot  itemr..  All  1 t'ln.u  a iiicj  lot  l.('rs  ot  tho 
alphabot  wore  ilofiiiod  as  non-rolovant  or 
ro<ja  ( ivc'-r.ol  letters.  In  some  cnr.cr,, 
anc  letter  of  tlie  alptiabet  was  positive, 
while  in  ot  tier  eases  tho  niomory  load  was 
increased  by  iiiakinp  as  many  as  eiciht 
letters  of  the  alphabi^t  positive.  VER ' s 
;»\TO  obt<iit)id  to  ])ri'S.('ritati  on  ol  positive 
and  nofja  t i \n  — sot  letters  sieparalely  for 
•■.'ich  memory  load  condition. 
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ITEMS  IN  Ml  MOMr  | 

Vigure  4.  Amplitude  of  1‘300  as  a 
j'unction  of  .Symbol  Relevance. 

When  v;e  analyzed  the  P,  wave,  we 
found  that  the  amplitudtt  of  tho  v/avoform 
induced  by  tho  "relevant"  or  po.sitive- 
set  items  was  routinttly  larger  than  that 
to  the  non-rolovant  items.  (I’ig.  4). 

This  diffc'jonce  was  larger  under  greater 
Ticmory  loatlij,  and  conflrm.s  many  previous 
studies  indicciting  tint  P,  i.s  extremely 
sensitive  to  the  "meaning'*  of  the  stim- 
ulus. With  this  son.sit-ivity , it  should 
be  pos.sible  to  utilize  this  peak  as  an 
index  ol  the  ability  of  tho  subject  to 
recognize  and  handle  inform.it  ion  jirescmt- 
'■-•d  in  a display.  Experiments  currently 
.heing  carricu  out  by  other  invest  iciators 
are  confirming  this  ('xpcctation.  It 
'as  bOE.-n  del  ermimnl  tli.it  the  p.^  amplitude 
is  significantly  circuit  or  when  the  subject 
secs  a familiar  f.acc  as  opposed  to  an 
anfamiliat  one. 

In  addition  to  the  above’  amplitude 
i I f rrences , we  ffnind  th.it  the  latc-ney 
yf  the  P^  varies  dircrctly  with  the” 
.'.emory  load  impo.sed,  at  lo.isf  al  these 
low  level:;. 


Figure  5.  Reaction  Time  and  P300 
Latency  for  different  Memory  Loads. 

Of  course,  reaction  time  also  varies 
with  memory  load.  However,  the  linear 
component  of  the  function  relating 
reaction  time  with  memory  load  accounts 
for  only  80  percent  of  the  variance, 
with  a strong  quadratic  component.  Con- 
sidering Pj  latency,  the  linear  componer 
account::  for  99  percent  of  the  variance. 
VJe  bc;lievc  this  indicates  that  the  VER, 
by  eliminating  most  of  the  motor 
variability  inherent  in  the  reaction 
time  measure,  provides  a much  more 
stable  and  reliable  index  of  cocjnitivo 
workload . 

In  anothc:r  study,  we  compared  the 
effects  of  a proposc'd  .aircraft  camou- 
flage p.aint  St.-home  on  recognition  of 
aircraft  attitudes  by  pilots.  P.'-'.iction 
times  of  subjects  viewing  photos  in 
different  attitudes  were  not  different 
with  the  differing  paint  scheme:;. 

Again,  one  could  question  whether  the 
processes  by  which  the  svibjects  wore 
responding  in  tact  differed,  even  tliougl 
they  led  to  tho  name  product;  in  this 
case,  a re.iction  time.  When  we  analyzer 
tho  VER  to  tho  various  paint  schemijs 
and  to  fiircriift  eittitudcs,  we  found  no 
major  differences  in  .implitude  or 
latency.  This  confirmed  the  reaction 
time  ro.snlts,  adding  more  detail  and 
credibilily  to  the  tindings.  It  also 
confirniofi  :uibjf'cti  ve  responses  of  no 
perception  of  iHfferenccs  bet-.'.-een  the 
two  schemi-:. . The  subject:;  thought  the 
stimuli  were  the  same,  and  therefore 
tliey  i>roi:i.'::s''d  them  in  tho  s.ime  way. 


5 


DoV(']  opnion  t c^f  l)('ninii  Staiularfir. 

.Ill  anoUit-T  c|on(>ral  c'lass  o£  invcLit- 
iqalion,  v.'c  art;  c>;p  I or  iri<)  Itu-  iioui^ibi.  lit.y 
of  u t.  i I i i -.u)  Uio  t o.uly  stale  fvokr'd 
iiT.ponso  to  cslalilislt  LU.>'uuiatcl'.;  tor  op- 
tical distortion  in  sncli  laminatiKi  ^ 
sub.st.inccs  as  aircraft  v.’lndscrcoiir. . 
bistort  ion  in  sucdi  ::ubstancos  nay  bn  so 
small  as  to  be  raitiliininal. , yet  be 
sufficient  to  cainu'  oiinr<itor  fatigue  or 
pci  tormance  disrujition.  While  it  may  lie 
po.ssit)le  to  dev'olop  physical  spocific'a- 
tions  lor  di::torl  ion,  it  i:;  not  easy  to 
determine  exactly  which  physical  anomalies 
correlat.c  with  beha.vioral  effect-S  vdien 
such  effects  are  subliminal.  because  of 
its  C'xtremc  sens  it  ivity  to  the  quality 
of  the  vi'iu.'il  imay'a,  tlio  steady  state  lil’ 
may  fiinpoiut  the  exact  anomalies  which 
are  ultimately  resulting  in  disturbances. 
Kfforts  are  currently  underway  to  look  at 
the  EP  response  to  t.nown  windscreen  dis- 
tortions, and  to  determine,  wliether 
simultant:ously  recorded  monocular  steady 
state  HP's  will  reveal  a difference  in 
phase  angle  or  amplitude  between  the  eyes 
indicative  of  early  interocular  rivalry 
and  fiiticjue. 

This  typo  of  effort  is  repircsentative 
of  a nunlier  of  enginccrinq  ajipl  i catioius 
which  can  capitilixe  on  the  sensitivity 
and  specificity  of  the  VER  to  define 
operator  display  demand;;  with  cjreatcr 
precision  than  most  psychophysical  or 
.subjective  measure.s.  .Since  the  hum  in  is 
the  ultimate  system  through  wliich  displays 
and  syste;.-,s  are  processed,  it  seems 
eminently  roason.iblt;  tfiat  we  should  util- 
ize the  human's  phy.siolociy  to  "calibrate" 
the  system  and  to  establish  standards. 

Such  an  upplicat  inn  has  been  dcmonstr,itcd 
by  Regan  et  al_-  ^ It  a chcckt.'i  board 
rli.splay  of  given  color,  intensity,  con- 
tra.st,  etc.,  is  presemted  to  a subject, 
the  amplitude  of  the  stoeidy  state  EP  can 
oe  determined.  If  any  one  parameter  of 
the  di;:play  is  chamjerj,  there  is  a 
cor res.pond i ng  amplitude  ch<uK)e  in  the  EP. 
for  instance,  if  the  di.splay  color  is 
rhang(?d,  the  EP  ;implitude  niicjtit  go  down. 

If,  however,  a "feedback"  loo[>  is  C'Stab- 
lished  v.’boreby  the  intensity  of  the 
displ.iy  will  increase  wtienever  the  EP 
amplitude  decrfiasc-s , the  experi.menter 
can  bring  the  amplitude  back  U[i  to 
previous  levels.  Thu::,  one  c.in  determine 
the  intensity  for  a "cjreen"  necessary 
to  make  it  produce  the  same  EP  as  a "red." 
In  effect  , one  has  achievc-d  a point  of 
"subjective"  erjuality  (at  least  physio- 
logically) without  C!vcr  asking  the 
subject.  Kucli  a tecliriiquc-  offers  broad 


promise  for  providing  objfictively 
determinefl  :;Landards  wliich  do  not 
icpiore  the  human. 

Cl i n i cal  Applications 

Although  the  major  thrust  of  our 
efforts  is  directed  to  opcr.iLiorial 
uti  li’/.ation  of  the  IIP,  it  is  impossible 
to  ignore  the  clinic:al  applications  of 
this  technicpie.  It  has  already  been 
mentioned  that  the  VER,_oan  be  used  to 
mea:;ure  visual  acuity. Similar 
techniques  are  available  to  nc-asurc 
visual  and  auditory  thresholds  in 
infants  and  mentally  retarflod  individ- 
uals, as  well  as  certain  aspects  of 
cognitive  function.’  Recent  research 
has  developed  technique::  for  utilizing 
the  VER  as  an  adjunct  the  diagnosis 
of  multiple  sclerosi.s,  certain  brain 
tumors,  learning  disabj^ity,  and  even 
psychiatric  disordor.s.  This  has  led 
in  part  to  a Memorandum  of  Agreement 
between  our  laboratory  and  the  Medical 
Center  at  Wright-Patterson  /"il'B  for 
cooperative  research  and  clinical  con- 
sultation. We  iiov/  regularly  receive 
referrals  from  the  Neurology,  Pedia- 
trics and  Mental  Health  clinic.s,  and 
have  begun  to  engage  in  clinical 
research  v;ith  physicians  from  the 
Medical  Center. 

FUTURE  niRECTIOMS 


For  the  future,  we  .sen  routine 
application  of  the  VF.R  technology  in 
the  Air  Force  for  the  types  of  human 
cnginacrincj  applicationn  described 
above.  In  other  laboratories,  most 
notably  in  the  U.S.  Navy,  the  potential 
of  the  VEK  is  being  tested  for  a.ssist- 
ing  in  personnel  selection  and 
evaluation.  beyond  these  already 
implemented  functions,  we  anticipate 
several  developments  v/hich  v.'ill 
dramat.icc'ill y ox|)and  the  utility  of  the 
VEK . 

EiUM ^ n t_  Ey o ked  Resp o n^s e s 

One  of  these  involve.';  the  method 
uscid  for  signal-to-noise  improvement. 

As  long  as  we  remain  dependent  on 
repetitive  sLimulatinri  and  ensemble 
averaging,  the  EP  will  liave  limited 
fioltl  app)  ieatio;i.  Alternative  tech- 
niques are  already  availahli-  and  ::how 
<jri-at  promise  of  allowing  us  to  isolate 
the  evoked  response  in  a single 
stimulus  presentation.  M.nlhc'm.itical 
treatments  such  as  principal  comnoncuit 
analys.i:; , step-wise  d i.scr imi  n.int 
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analyni<:  and  colierenco  fuiu-tionr:  can  bo 
used  to  match  a )->ro-o.\i  sti  mj  template. 

More  elaborate  r.yr.tems  vu;o  malched 
filteiu  or  a combination  of  ilteri  n<j 

and  crons-correl at i on  to  del  ermine  when 
an  evoked  renpon-ae  has  occurred.  I'llun 
thc.se  r.ystems  become  opc;rat  i f)iial , on-line 
evaluation  of  the  subject's  MKf:  will, 
become  possible  without  the  artificial 
laboratory  situation  required  by 
repetitive  stimulation. 

Endogenous  St i mu  1 i 

Another  major  limitation  of  the  EP 
as  jiroju-ntly  used  is  its  dependence  on 
an  cxlei"nal  .stimulus  event  to  serve  as  a 
"markc-r"  for  the  iH'ginninq  of  a sampling 
period.  In  jjracticc,  this  hii.s  required 
us  to  us(!  discrt'te  sensory  events,  al- 
though many  situations  of  ijiterc.st  do 
not  i nt  1' i ns i cal  1 y lend  tlictnselves  to  .su'-h 
discontinuous  f.t  imulation  (e.g.,  ma- 
reading,  photo-interpretation,  cop 
dcci  si  on-maki  ng,  etc.).  In  sucli 
one  would  1 ike  to  know  the  preci 
stant  in  which  a mciin i ngf u 1 .stir 
began  to  operate  v/itiil'n  tile  ind.  ...at. 
Even  if  one  could  identify  the  point  at 
which  a sensation  began  in  a given  cog- 
nitive task,  this  still  might  not  be  the 
point  at  vdiich  the  sensation  became  a 
percept! on  and  began  to  be  processed  by 
the  individual. 

Such  a dilemma  has  caused  us  to 
begin  searching  for  "endogenous"  stimuli 
to  use  an  triggers  for  the  EP.  If  we  can 
identi 1 y some  event  within  the  person 
v;hich  signals  that  the  processing  has 
actually  begun,  we  could  use  that  event 
to  begin  sampling  the  EEC.  One  of  the 
most  o.bvious  of  such  endogenous  stimuli 
involves  the  subject's  own  eye  movements. 
Researchers  have  already  established 
that  t)io  eye  movements  and  fixations  can 
bo  used  to  pinpoint  meaninglul  events  in 
the  EEC  vjhich  v;erc  ot))erv/i  .se  uninterprot- 
able.  We  are  planning  to  use  the 
precision  offered  by  the  Stanford  Research 
Institute  eye  tracker  to  doterinine 
whether  triggering  off  the  initiation  or 
terminal  ion  of  an  eye  movement  will 
reveal  micro-components  of  Llie  EP  w'lich 
arc  missed  whf'n  the  extcTiial  event  is 
used  as  a trigger.  It  sliould  also  be 
poGsiblt;  to  u.se  the  EP  itself  as  a trigger 
for  cinother  EP.  11  v/c  imprfive  our 
capability  to  identify  the  eaily  "sensory" 
events  in  the  EP  on  a single  .stimulus, 
then  we  might  use  one  of  events 

(such  as  the  P^)  to  tritjger  another 
sampling  epoch.  'J’lie  adfled  milliseconds 
oi  precifiion  offf;re<j  by  tlii  ;;  teclini<juc. 


as  opposed  to  using  the  exlc-inal  evc-iii  , 
might,  i eveal  a ejreat  deal  iiiorn  complex- 
ity and  detail  in  th.e  " procc.-;,;;  i ng" 
segiiK'nt  of  the  EP  than  va;  pre;-,ontly  :;i  ■ 
in  the  P300  peak.  Devel  opments  such  a:: 
these  v/i.ll  go  I'ar  in  reducing  the 
ajiijarc'iiL  variability  of  tlir?  Idle,  betv;e.  . 
subjects,  and  further  enrich  tlie  detail 
of  the  EP  as  a metric. 

^uman  Eiigineerin<)  JI'C2t_Bat^'ry 

As  a far-reaching  goal,  it  is 
pos.sible  to  concc-ivc  of  stai.dar  dized 
procedures  for  hum.jn  cngineci  intj 
applications  utilizing  the  EP  and  oLhr  ;■ 
p.sychojiliysi ol  ogi c.i  1 and  behavioral 
techniques.  Some  attempts  at  such  a 
test  battery  have  been  made  in  the 
past,  but  those  have  been  limited  by 
the  state-of-the-art  in  recording  and 
analysis,  and  by  the  fact  that  adequate 
basic  re.scarch  in  [jsychopliy.siol  ogical 
techniques  had  not  yet  her n done.  As 
we  have  seen,  the  research  is  now 
being  done,  at  an  accelerated  pace.  In 
addition,  it  is  time  to  begin  capital- 
izing on  the  enormou.s  computer  and 
analytical  power  nov;  being  developed  fo 
bio-medical  data.  Such  power  allows  us 
to  conceive  of  many-channel  EEC 
recordings,  combined  with  other  psycho- 
physiological  and  behavioral  measures. 
Such  a multivari  at  i-'  approach  has  alread 
been  used  succe.ssf n lly  in  the  develop- 
ment of  a "neurometries  test  battery" 
for  the  rapid  assessment  of  neuro- 
logical ])roblcms  in  children.  ' In 
this  battery,  57  brain  sites  can  be 
monitored  during  50  different  tost 
items  or  "ch.il  1 enges  , " yielding  as 
many  as  85,000  measures  in  a test 
session  lasting  from  15  to  50  minutes. 
This  cnoianous  quantity  of  data  is 
reduced  by  pattern  recognition  tech- 
niques to  some  80  measures,  yielding 
a com)jlctc  neurological  survey, 
examining  cvcrytliing  from  hyper- 
activity to  drug  effects.  It  is  not  at 
all  inconceivable  that  such  a tost 
battery  could  be  developed  specifically 
for  the  typo  of  human  ongincej'ing  and 
personnel  applications  described  in 
this  paper.  Tlie  major  advantages  of 
such  a system  would  bo  its  objectivity, 
specificity,  and,  since  it  would  deal 
with  processes  r.ttber  than  siiuply 
products,  its  ability  to  bc'  tp.'iiorali  zed 
from  one  design  (jucstion  to  anotiier. 
Added  to  the  dove  1 (rpments  nu'nt  ioned 
above,  suclr  a system  should  allow  on- 
linn  evaluation  of  the  operator, 
permitting  assessment  of  f,iti<ju(', 
attention,  psychological  diidiess,  or 


othcM'  pot  I'nt  i;il  ly  daiKjcn'our.  state::. 

WiMi  .lay  dav'e  1 opm  ■ at  v/'iirti  shows 
eonsidi'i  al)  U'  in  .1  dsd  ined  area  oi 

iippl  i ca  I i 0:1 , it  i i-asy  to  t)0  ov(>rly 
c>pt  i 111  i t ie  alioiit  tlie  luLure.  V/o  liave 
alJowi'd  out  :;i'l  V('S  .1  deitreo  of  latitude 
in  spc'culalinq  wlu'ie  tliis  newly  applied 
rot  lie  will  protwed  in  the  future.  How- 
e\’('r,  we  are  not  unaware  of  the 
diffieult  ies  which  lie-  ahead,  and  we  do 
not  underest,  iin.ite  the  maqn  i tui.le  of  ttic 
problems  to  bo  .'loli’c'd.  Workers  in  this 
arc-a  are  operat  inej  at  the  f ront.ier  of 
technology  in  electionics,  in  mat  hematics , 
in  medicine,  and  in  jiriyohol oqy . Not  all 
devv' I opnienl  ::  which  now  seem  feasible  will 
prove  so.  Yet,  a hard  appraisal  of 
-cradeoffs  convinces  ns  tdiat  the  effort  is 
worth  ttie  risk.  It  even  a part  of  the 
app.irrnf  capability  is  achieved,  it  v;ill 
be  worthwhile. 

The  principal  danyors  in  this  apjiroach 
lie  not  so  much  in  the  technical  sophisti- 
cation or  difficulties  involved,  but  in 
the  pos.sibility  for  misuse  and  over- 
ejener.;]  i nation.  Tlic  EP  is  certainly  no 
piinacea  for  all  design  problems.  It  can 
never  replace  subjective  report,  and  can 
never  substitute  lor  inadequate  designs. 

If  anything,  it  rc'quLres  more  care  and 
more  sophistication  in  e.xper imental 
design  than  previous  metrics.  The 
increased  precision  and  sensitivity  is 
purchased  at  the  cost,  of  inc;re^^sed  need 
for  attention  to  detail  find  for 
cxjierinic  nta  1 validation  of  interpretations. 
T t.  is  inevitable  tliat  mistakes  viill  be 
made  and  misinterpretations  will  become 
an  cverpjrcsent  threat  . 

In  spite  of  tlrese  possibilities, 

•wo  believe  that  the  VER  technique  has 
opened  a door  for  a now  kind  of  measure- 
nent  rifiprOiich  in  luiman  engineering.  The 
:!()f>roach  attempts  to  be  functionally 
related  to  real  woi  Id  events,  <ind  to 
analyzf'  proces.s  ;is  well  as  product.  It 
rcpresc'nts  a bold  attempt  to  provide  a 
quantum  increase  in  the  precision  of 
analysis.  In  nummary,  we  fr.-el  the 
t''chni(jui‘  provides  perhaps  tlie  first  true 
nicrost'ope  tlic  human  engineer  has  ever 
possessed . 
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